(19) 



J 



(12) 



(43) Date of publication: 

24.02.1999 Bulletin 1999/08 



Europaisches Patentarrrt 
European Patent Office 

Office europeen des brevets (11) EP0 898 410 A2 

EUROPEAN PATENT APPLICATION 

(51) Int. CI. 6 : H04N 1/00 



(21) Application number: 98115628.4 

(22) Date of filing: 19.08.1998 



(84) Designated Contracting States: 


(72) Inventor: Maeda, Toru 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


Ohta-ku, Tokyo (JP) 


MCNL PTSE 




Designated Extension States: 


(74) Representative: 


AL LT LV MK RO SI 


Pellmann, Hans-Bernd, Dipl.-lng. et al 




Patentanwaltsburo 


(30) Priority: 21.08.1997 J P 240496/97 


Tiedtke-Buhling-Kinne & Partner 


Bavariaring 4 


(71) Applicant: 


80336 Munchen (DE) 


CANON KABUSHIKI KAISHA 




Ohta-kuTokyo146(JP) 





CM 
< 



(54) Image communication system using electronic mail and control method therefor 



(57) An image communication system including 
electronic-mail apparatuses each having a function to 
add image-file processing information to an image file 
attached to an electronic mail. The image processing 
capability of each apparatus is examined in advance. In 
a transmitting-side apparatus, an image file is gener- 
ated in accordance with the capability, and an electronic 
mail, to which the image file is attached, is transmitted 
to a receiving-side apparatus. Further, if the image file 
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attached to the transmitted electronic mail cannot be 
processed by the receiving-side apparatus, the receiv- 
ing-side apparatus notifies the transmitting-side appara- 
tus of clarified cause of processing failure, further, 
transmits its image-file processing capability and the 
unprocessed transmitted electronic mail to the transmit- 
ting-side apparatus. Thus, efficient image-file transmis- 
sion/reception can be performed. 
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Description 

BACKGROUND OF THE INVENTION 

[0001 ] The present invention relates to an image com- s 
munication system using an electronic-mail apparatus 
which delivers messages, documents and the like via a 
communication network. 

[0002] Conventionally, an image file attached to a 
message can be transmitted by utilizing an electronic- w 
mail system. However, in this electronic-mail system, a 
transmitting side sends an image file in a format 
selected by the transmitting side to a receiving side, on 
the premise that the receiving side can handle the 
image file. 15 
[0003] Accordingly, the receiving side often fails to 
process the image file attached to the received E-mail 
(electronic mail). Each time such trouble occurs, an 
operator of the receiving side has to inform the transmit- 
ting side that the receiving side cannot handle the 20 
image file attached to the received E-mail by using a tel- 
ephone or by transmitting a reply E-mail (hereinafter 
referred to as a "process failure notification") to the 
transmitting side. Further, an operator of the receiving 
side has to request an operator of the transmitting side 25 
to change the format of the image file and retransmit the 
E-mail to which the image file of the changed format is 
attached. 

[0004] On the other hand, The operator of the trans- 
mitting side has to change the format of the image file in 30 
response to the request from the receiving side, regen- 
erate the E-mail to which the image file of the changed 
format is attached, and retransmit the E-mail. Further, 
even when the transmitting side receives a processing- 
failure notification, if the cause of the processing failure 35 
is unknown, the transmitting side cannot take any meas- 
ure to cope with the problem. Further, when the receiv- 
ing side tries to return an unprocessed image file to the 
transmitting side, if the image file has a large amount of 
information, the transmission causes load on the net- 40 
work. 

[0005] It is possible to examine the image file process- 
ing capability of the receiving side apparatus prior to E- 
mail communication, then attach an image file in a for- 
mat corresponding to the processing capability to an E- 45 
mail and transmit the E-mail. However, to examine the 
image-file processing capability of the receiving side 
apparatus by using an E-mail protocol, a special E-mail 
protocol is required , and general E-mail communicabil- 
ity might be lost due to such special protocol. Further, in so 
this case, the system must be greatly changed. 

SUMMARY OF THE INVENTION 

[0006] The present invention has its object to provide 55 
an image communication system using electronic mail, 
capable of checking image-file processing capability of 
a receiving apparatus, generating an image file corre- 



sponding to the processing capability and transmitting 
the converted image file, without substantial system 
change, and a control method for the system. 
[0007] Another object of the present invention is to 
provide an image-file communication system using 
electronic mail, where, if a received E-mail cannot be 
processed, a receiving side notifies its processing capa- 
bility to a transmitting side such that the transmitting 
side is clearly informed of processing necessary for 
retransmission and can easily perform image file con- 
version necessary for retransmission, and a control 
method for the system. 

[0008] Other objects and advantages besides those 
discussed above shall be apparent to those skilled in 
the art from the description of a preferred embodiment 
of the invention which follows. In the description, refer- 
ence is made to accompanying drawings, which form a 
part thereof, and which illustrate an example of the 
invention. Such example, however, is not exhaustive of 
the various embodiments of the invention, and therefore 
reference is made to the claims which follow the 
description for determining the scope of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] The accompanying drawings, which are incor- 
porated in and constitute a part of the specification, 
illustrate embodiments of the invention and, together 
with the description, serve to explain the principles of 
the invention. 

Fig. 1 is a block diagram showing the construction 
of an electronic-mail communication system 
according to an embodiment of the present inven- 
tion; 

Fig. 2 is a flowchart showing an image transmission 
operation of an electronic-mail apparatus according 
to the embodiment; 

Fig. 3 is a flowchart showing an image reception 
operation of the electronic-mail apparatus accord- 
ing to the embodiment; 

Fig. 4 is a flowchart showing operation for generat- 
ing an Image Description of a facsimile transmis- 
sion message according to the embodiment; 
Fig. 5 is a flowchart showing operation for generat- 
ing an Image Description of a capability request 
message according to the embodiment; 
Fig. 6 is a flowchart showing operation for generat- 
ing an Image Description of a capability response 
message according to the embodiment; 
Fig. 7 is a flowchart showing operation for generat- 
ing an Image Description of a image-processing 
confirmation message; and 
Fig. 8 is a schematic diagram showing an example 
of the Image Description of a facsimile transmission 
message of the embodiment; 
Fig. 9 is a schematic diagram showing an example 
of the Image Description of a capability request 
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message of the embodiment; 

Fig. 10 is a schematic diagram showing an example 

of the Image Description of a capability response 

message of the embodiment; 

Fig. 1 1 is a schematic diagram showing an example 

of the Image Description of a image-processing 

confirmation message of the embodiment; and 

Fig. 12 is a schematic diagram showing the format 

of data written in the Image Description. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

[0010] Hereinbelow, the construction, operation and 
advantages ol image file communication system as a 
preferred embodiment of the present invention will be 
described in detail in accordance with the accompany- 
ing drawings. 

[001 1] First, the construction of the overall system of 
the embodiment will be described with reference to Fig. 
1 . In Fig. 1 , an electronic-mail apparatus 1 is a transmit- 
ting-side apparatus which sends an image, and an elec- 
tronic-mail apparatus 2 is a receiving-side apparatus 
which receives an image. An E-mail server 3 performs 
mail transmission/reception of the transmitting-side 
apparatus 1 . An E-mail server 5 performs mail transmis- 
sion/reception of the receiving-side apparatus 2. A net- 
work 4 is a communication network such as an Internet 
and carries an E-mail between the E-mail servers 3 and 
5. 

[001 2] The transmitting-side electronic-mail apparatus 
1 has a scanner 6 which reads an original, an image 
reading processor 7 which encodes the read image, 
converts the coded image as an image file and gener- 
ates a message included in the image file, a transmis- 
sion processor 8 which transmits an E-mail to the E-mail 
server 3 by using SMTP protocol, a reception processor 
9 which receives an E-mail from the E-mail server 3, a 
destination capability processor 10 which judges desti- 
nation capability information on the capability of a desti- 
nation apparatus received by E-mail and processes the 
information (the processing of the destination capability 
processor 10 will be referred to as "destination capabil- 
ity processing"), a destination capability storage unit 1 1 
for storing destination capability information in corre- 
spondence with a destination apparatus, and reading 
the destination capability information in accordance with 
the destination apparatus, and a timer 20 which per- 
forms various time measuring operations. 
[001 3] The receiving-side electronic-mail apparatus 2 
has a reception processor 1 2 which receives an E-mail 
from the E-mail server 5, an image file processor 13 
which extracts an image file from an E-mail and 
decodes the image file, a printer 14 which print-outputs 
an image, a processing failure notifier 1 5 which gener- 
ates an error notification message if an image file can- 
not be processed by the image file processor 13, a self 
capability notifier 16 which notifies the capability of the 



apparatus 2 by an E-mail, a transmission processor 17 
which transmits an E-mail to the E-mail server 5, and a 
timer 21 which performs various time measuring opera- 
tions. 

5 [0014] The outline of overall operation in the system 
having the above construction will be described. First, 
an image read by the scanner 6 of the transmitting-side 
electronic-mail apparatus 1 is converted by the image 
reading processor 7 into an image file. Then the trans- 

10 mission processor 8 generates a transmission E-mail to 
which the image file is attached, and delivers the E-mail 
to the E-mail server 3 as a nearest E-mail server by 
using SMTP protocol. The E-mail server 3 delivers the 
E-mail via the network 4 to the E-mail server 5 con- 

15 nected to the destination apparatus. The E-mail server 
5 sends the E-mail to the receiving side electronic-mail 
apparatus 2. 

[0015] The SMTP is a protocol used between the 
transmitting-side electronic-mail apparatus and the E- 

20 mail servers, and between the E-mail servers. As 
described above, the E-mail is transmitted by using the 
SMTP on the network 4, but if the destination apparatus 
does not support the SMTP protocol, i.e., is not a SMTP 
server, then the E-mail can not be received to the desti- 

25 nation apparatus. The function of SMTP server is gen- 
erally installed to an UNIX™ server or Windows NT™ 
server, but is not installed in a user terminal. Therefore, 
the user terminal retrieves the E-mail from the nearest 
server by using a protocol, such as POP In the present 

30 embodiment, the transmitting-side electronic-mail appa- 
ratus 1 and the receiving-side electronic-mail apparatus 
2 are capable of using the SMTP protocol upon mail 
transmission/reception. 

[001 6] The E-mail, send from the E-mail sever 5 to the 

35 receiving-side electronic-mail apparatus 2, is delivered 
to the reception processor 12. The reception processor 
12 performs image processing on the E-mail, and if no 
trouble occurs, the image file is print-outputted by the 
printer 14 of the receiving-side apparatus 2. An image- 

40 processing confirmation message is generated by the 
processing failure notifier 15, and information on the 
capability of the receiving-side apparatus 2 is added to 
the message by the self capability notifier 16. The trans- 
mission processor 17 attaches the message to an E- 

45 mail and transmits the E-mail to the E-mail server 5. 
[0017] As a result of the image processing by the 
reception processor 12, if trouble occurs, the process- 
ing failure notifier 15 generates a processing-failure 
notification message having a transmission message ID 

so of the failed E-mail and information on the cause of 
processing failure. The transmission processor 17 
attaches the processing-failure notification message to 
an E-mail, and transmits the E-mail to the E-mail server 
5 by using SMTP protocol. 

55 [0018] The E-mail server 5 delivers the E-mail via the 
network 4 to the E-mail server 3 connected to the desti- 
nation apparatus. The E-mail server 3 sends the E-mail 
to the transmitting-side apparatus 1 . The E-mail is deliv- 
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ered to the reception processor 9. The reception proc- 
essor 9 interprets the E-mail, and performs necessary 
processing. 

[0019] Note that in the above construction, the main 
functions of the transmitting-side apparatus 1 and those 
of the receiving-side apparatus 2 are clearly discrimi- 
nated from each other However, normally, the appara- 
tuses have common functions. 

[0020] Further, although general constituents such as 
a CPU and a memory which are basic functions of the 
E-mail apparatus are not shown in Fig. 1, the appara- 
tuses include these constituents, and the respective 
operations to be described below are executed by the 
CPU in accordance with a control program stored in the 
memory. 

[0021] Further, as the control program executed by the 
CPU, as well as a programs stored in a dedicated mem- 
ory (ROM) in advance, a program stored in various stor- 
age media such as a floppy disk, a hard disk and a CD- 
ROM can be used. The program stored in the storage 
medium is read by a reading device (not shown) of the 
electronic-mail apparatus, and interpreted and executed 
by the CPU. 

[0022] Next, the structure of an image file attached to 
an E-mail will be described. 

[0023] The format of an image file used in the present 
embodiment is a TIFF file format, and an image is 
stored in a format defined by TIFF (a file format for a PC 
(personal computer) developed by Aldus Corporation; 
details of the TIFF format will be omitted in this embod- 
iment). 

[0024] In a TIFF file, in its Image Description, a com- 
ment on an image can be added. In the comment field, 
data necessary for capability exchange is stored in the 
form of ASCII, where a string which ends with Null can 
be stored, with a 270 (10EH) tag. 
[0025] Hereinbelow, newly defined portions of the 
TIFF file according to the embodiment of the present 
invention will be described. 

[0026] First, as shown in Fig. 12, in the format of 
Image Description, a value "image/ITUFax" indicative of 
capability exchange data is set as a keyword at the 
head of the format. 

(1) Message Type 

[0027] Message types are as follows: 

MsgType=0: facsimile transmission 

MsgType= 1 : capabil ity request 

MsgType-2: capability response 

Msgtype=3: image-processing confirmation 

(2) Transmission Message ID 

[0028] A transmission message ID is an identification 
number assigned by a transmitting apparatus. The 
transmission message ID is represented as: 



TxMsgID = a decimal number with a maximum of ten 
digits 

(3) Response Message ID 

5 

[0029] A response message ID is a message ID to a 
polling request. The response message ID is repre- 
sented as: RspMsgID = a decimal number with on a 
maximum of ten digits 

10 

(4) Transmission Facsimile Number 

[0030] A transmission facsimile number (telephone 
number) indicates a facsimile number of the transmitting 
is apparatus. The transmission facsimile number is stored 
when the message type is "1 The transmission facsim- 
ile number is represented as: 
TxFaxNo = actual facsimile number 

20 (5) Reception Facsimile Number 

[0031] A reception facsimile number indicates a fac- 
simile number of a receiving apparatus. The reception 
facsimile number is stored when the message type is 
25 "2". The reception facsimile number is represented as: 
RxFaxNo = actual facsimile number 

(6) Completion Code 

30 [0032] A completion code is used to transmit a com- 
munication result. The completion code is stored when 
the message type is "3". 

"CompCode = 0° means "normal status", while "Comp- 
Code = 1 " means "error". 

35 

(7) Page Reception Status 

[0033] A page reception status indicates whether or 
not reception pages have been normally received. The 

40 page reception status is a binary data. If the value is "0", 
the status is "normal", while if the value is "1 ", the status 
is "error". The status is represented by a hexadecimal 
octet unit, and is sent as an ASCII code. The head octet 
LSB indicates the first page. 

45 [0034] For example, in case of PageRecSts = 0C, the 
status is "00001 100" in binary representation, meaning 
that an error has occurred in the reception of the third 
and fourth pages. 

so (8) T30 Signal 

[0035] A signal in the ITU-T Reccommendation T.30 is 
used as a keyword. The content of FIF in hexadecimal 
representation follows after a sign "=". The T.30 signal is 
55 represented as octet-unit LSB-f irst data. 

[0036] For example, in case of DIS = OOC200, the bit 
"10", "15" and "16" of the FIF of the DIS are "1". 
[0037] In the frame structure as described above, an 
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image file is transferred by E-mail at the following steps 
1 to 4. 

(Stepl) 

[0038] At the transmitting -side apparatus 1 . before an 
original is read, the transmitting-side apparatus 1 trans- 
mits a capability request with the message type "1" by 
E-mail to examine the reception capability of the receiv- 
ing-side apparatus 2. At this time, the capability of the 
transmitting-side apparatus 1 is sent as M DIS= Fig. 9 
shows an example of the contents described in the 
Image Description in a capability request TIFF file. 

(Step 2) 

[0039] The receiving-side apparatus 2 receives the 
capability request by E-mail, and transmits a capability 
response with the message type "2" indicative of the 
reception capability of the receiving-side apparatus by 
E-mail. The information "DIS= " sent from the transmit- 
ting-side apparatus is stored into the destination capa- 
bility storage unit (not shown as the constituent of the 
receiving-side apparatus 2) in correspondence with the 
destination apparatus. Fig. 10 shows an example of the 
contents described in the Image Description in a capa- 
bility response TIFF file. 

(Step 3) 

[0040] The transmitting-side apparatus 1 receives the 
capability response, then reads the original within the 
range of the capability designated by the receiving-side 
apparatus, and transmits image data as an attachment 
file of an E-mail. The information "DIS= " sent from the 
receiving-side apparatus 2 is stored into the destination 
capability storage unit 11 in correspondence with the 
destination apparatus. Fig. 8 shows an example of the 
contents described in the Image Description in an fac- 
simile transmission TIFF file. 

(Step 4) 

[0041] The receiving-side apparatus 2 receives the 
facsimile transmission message by E-mail, then print- 
outputs the image file, and transmits an image-process- 
ing confirmation message to the transmitting-side appa- 
ratus 1 . The transmitting-side apparatus 1 receives the 
image-processing confirmation message, and gener- 
ates a delivery confirmation report. The information 
H DIS= " sent from the receiving-side apparatus 2 is 
stored in correspondence with the destination appara- 
tus. 

[0042] Fig. 1 1 shows an example of the contents 
described in the Image Description in an image- 
processing confirmation TIFF file. 
[0043] Next, the operation of the electronic-mail appa- 
ratus having the above construction will be described 



with reference to the flowcharts of Figs. 2 to 7. Note that 
the following operations are performed by the CPU's in 
the respective electronic-mail apparatuses 1 and 2. 
[0044] First, the operation upon image transmission in 
5 the transmitting-side apparatus 1 to store the capability 
information of the receiving-side apparatus 2 will be 
described. 

[0045] In Fig. 2, in the transmitting-side apparatus 1, 
when a destination is inputted at step S201, it is exam- 

10 ined at step S202 whether or not the capability data of 
the inputted destination is stored in the destination 
capability storage unit 11. If the capability data is not 
stored, a capability request message is generated at 
step S21 3, in accordance with the procedure in the f low- 

15 chart of Fig. 5. 

[0046] In Fig. 5, the capability exchange keyword is 
set at step S501, and the message type is set to "1" 
(capability request) at step S502. At step S503, time 
data is read from the timer 20, and at step S504, the 

20 transmission message ID is set from "yea r - rn o ntn " da y" 
hour-minute-second" of the time data. At step S505, the 
transmission facsimile number is set, and at step S506, 
the capability of the transmitting-side apparatus 1 is 
converted into "DIS=" FIF information with the T.30 DIS 

25 signal as a keyword, and added as transmission mail 
information to the message. 

[0047] Next, a transmission mail is transmitted at step 
S214. At this time, the capability request message gen- 
erated at step 213 is sent as an E-mail by the transmis- 
30 sion processor 8 to the E-mail server 3, and transferred 
via the network 4, to the E-mail server 5 connected to 
the destination apparatus. 

[0048] At the receiving-side apparatus 2, the E-mail is 
processed in accordance with the procedure in the flow- 
35 chart of Fig. 3. 

[0049] In Fig. 3, at step S301 , the E-mail is read from 
the E-mail server 5 by the reception processor 12, and 
the message type in the Image Description of the E-mail 
is examined. 

40 [0050] If the message is not a facsimile transmission 
message (NO at step S302) but is a capability request 
message (YES at step S309), a capability response 
message is generated at step S310, in accordance with 
the procedure in the flowchart of Fig. 6 to generated an 

45 Image Description capability response message. If the 
message is not a capability request message (NO at 
step S309), a transmission error message is generated 
at step S311. The transmission error message is 
attached to an E-mail and sent to the E-mail server 5 by 

so the transmission processor 17 at step S312, and trans- 
ferred via the network 4 to the E-mail server 3 con- 
nected to the destination apparatus. 
[0051] Referring to Fig. 6, in the Image Description 
format as shown in Fig. 12, the above-described capa- 

55 bility exchange keyword is set (S60 1 ) , and the message 
type (= 2 (capability response)), the transmission mes- 
sage ID, the transmission facsimile number, and the 
reception facsimile number are seguentially set (S602- 
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S605). Further, the capability data of the receiving-side 
apparatus is added to the FIF information of the DIS sig- 
nal (S606). Thus, the capability response message is 
completed. 

[0052] At step S31 2, the capability response message 
is attached to an E-mail and sent to the E-mail server 5 
by the transmission processor 17, and transferred via 
the network 4 to the E-mail server 3 connected to the 
destination apparatus. 

[00531 Thereafter, in the transmitting-side apparatus 
1 , the E-mail is processed in accordance with the proce- 
dure in the flowchart of Fig. 2. At step S215, the E-mail 
is received by the reception processor 9 of the transmit- 
ting-side apparatus 1. If it is determined at step S216 
that the E-mail corresponds to the transmission mes- 
sage ID in the capability request, and if it is determined 
at step S217 that the E-mail is a capability response 
message, the destination capability processing is per- 
formed by the destination capability processor 10 at 
step S218. Then, the destination capability data is 
stored in the destination capability storage unit 1 1 at 
step S219. 

[0054] The destination capability storage unit 1 1 has 
destination capability storage directories for respective 
destination apparatuses. The destination capability data 
is stored in a destination capability storage directory 
corresponding to the destination apparatus. 
[0055] Note that if it is determined in step S216 that 
the transmission message ID'S do not coincide or it is 
determined at step S217 that the E-mail is not a capa- 
bility response message, message error processing is 
performed at step S220. Then the process returns to 
step S214 to perform retransmission processing. 
[0056] Next, the operation of the transmitting-side 
apparatus 1 to read an image, designate a destination 
and transmit image data and the operation of the receiv- 
ing-side apparatus 2 to print-output will be described. 
[0057] In Fig. 2, at the transmitting-side apparatus 1 , 
when the destination is inputted at step S201, it is 
examined at step S202 whether or not destination capa- 
bility data corresponding to the destination is stored in 
the destination capability storage unit 11. If the destina- 
tion capability data exists, it is read at step S203, and at 
step S204, an image is read by the scanner 6 in accord- 
ance with the destination capability data. Then image 
data is encoded by the image reading processor 7 at 
step S205, and converted into an image file. 
[0058] Then, a facsimile transmission message is 
generated in accordance with the flowchart of Fig. 4. 
First, in the Image Description format as shown in Fig. 
12, the above-described capability exchange keyword is 
set (S401), then, the message type is set to "0" (facsim- 
ile transmission) (S402). 

[0059] Next, time data is read from the timer 20 

(5403) , and a transmission message ID is set from 
"year-month-day-hour-minute-second" of the time data 

(5404) . Then, the transmission facsimile number is set 

(5405) , and the capability data of the transmitting-side 



apparatus 1 is added to the FIF information of the DIS 
signal (S406). 

[0060] Further, the reception facsimile number is set 
(S405), and the capability data of the receiving-side 
5 apparatus 2 is added to the FIF information of the DIS 
signal (S406). 

[0061 ] The facsimile transmission message generated 
in accordance with the procedure in the flowchart of Fig. 
4 is sent as an E-mail by the transmission processor 8 

io to the E-mail server 3 at step S206. Then the E-mail is 
transferred via the network 4 to the E-mail server 5 con- 
nected to the destination apparatus. 
[0062] Thereafter, in the receiving-side apparatus 2, 
the E-mail is processed by the reception processor 12 in 

15 accordance with the procedure in the flowchart of Fig. 3. 
[0063] In Fig. 3, the message type in the Image 
Description in the E-mail is examined by the reception 
processor 12 at step S301. If it is determined at step 
S302 that the E-mail is a facsimile transmission mes- 

20 sage, the image-file processor 13 extracts and decodes 
the image file at step S303, and it is determined at step 
S304 whether or not the image file can be processed. If 
the image file can be processed, the image is print-out- 
putted by the printer 14 at step S305. Then, at step 

25 S306, an image-processing confirmation message 
indicative of the completion of processing is generated 
in accordance with the procedure in the flowchart of Fig. 
7, and the message is sent to the transmitting-side 
apparatus 1 . 

30 [0064] In Fig. 7, first, in the Image Description format 
as shown in Fig. 12, the above-described capability 
exchange keyword is set (S701), then, the message 
type is set to "3" (image processing confirmation) 
(S702). 

35 [0065] Next, the transmission message ID, the trans- 
mission facsimile number, the reception facsimile 
number, the completion code (CompCode = 0), and the 
page reception status are sequentially set (S703-S708). 
Then, the capability data of the receiving-side appara- 

40 tus 1 is added to the FIF information of the DIS sig- 
nal(S708). 

[0066] Further, at step S304 in Fig. 3, if the image file 
cannot be processed, the processing-failure notification 
processing is performed at step S308. An image- 

45 processing confirmation message indicating that the 
processing has not been normally completed is gener- 
ated in accordance with the procedure in the flowchart 
of Fig. 7. The message is transmitted to the transmit- 
ting-side apparatus 1. This message is generated by 

so setting the completion code to "1" (CompCode = 1) 
indicative of an image processing error at step S706. 
[0067] The image-processing confirmation message 
is attached to an E-mail and sent to the E-mail server 5 
by the transmission processor 17 at step S312, and 

55 transferred via the network 4 to the E-mail server 3 con- 
nected to the destination apparatus. 
[0068] Thereafter, at the transmitting-side apparatus 
1 , the E-mail is processed in accordance with the proce- 



6 

<EP_ 089841 0A2 I > 



11 



EP0 898 410 A2 



12 



dure in the flowchart of Fig. 2. That is, the E-mail is 
received by the reception processor 9 of the transmit- 
ting-side apparatus 1 (S207). If it is determined that the 
E-mail corresponds to the transmission message ID 
(S208A). and it is determined that the E-mail is an 
image-processing confirmation message (S208B), the 
completion code and the page reception status are 
checked (S209 and S210). then a delivery confirmation 
report is generated (S221). Then, the destination capa- 
bility processing is performed, and the destination capa- 
bility data is stored (S222). 

[0069] Note that if it is determined at step S208A that 
the E-mail is not an image-processing confirmation 
message or it is determined at step S208B that the E- 
mail does not correspond to the transmission message 
ID, message error processing is performed at step 
S211, and the process returns to step S206 to repeat 
the transmission processing. Further, if appropriate 
value is not detected at steps S209 and S210, error 
retransmission processing is performed at step S212, 
and the process returns to step S206 to repeat the 
transmission processing. 

[0070] As described above, in the transmitting-side 
apparatus 1, the destination capability is examined and 
the capability is stored in advance, and an image file 
corresponding to the destination apparatus is transmit- 
ted. Thus, the functions of the transmitting-side appara- 
tus 1 are fully utilized, and the reliability of the 
processing in the receiving-side apparatus 2 can be 
improved. 

[0071] Further, if a received E-mail cannot be proc- 
essed , the situation is notified with clarified cause of 
processing-failure. 

[0072] Note that in the above example, the TIFF for- 
mat is employed as an image file format, however, other 
file formats such as FlashPix, EXiF and JFIF may be 
used. 

[0073] As described above, according to the present 
invention, the electronic-mail apparatus has a function 
to add information necessary for image-file reception 
processing to an image file attached to an E-mail and 
transmit the E-mail. By this construction, the apparatus 
generates an image file which can be processed by the 
receiving -side apparatus in accordance with the capa- 
bility of the receiving -side apparatus and transmits the 
image file. This realizes smooth E-mail transmission. 
[0074] In a case where an image file attached to a 
transmission E-mail cannot be processed in the receiv- 
ing-side apparatus, "notification with clarified cause of 
processing failure" is made, further, the "capability of 
receiving-side apparatus" and the "image file that can- 
not be processed" are informed to the transmitting-side 
apparatus. Accordingly, the transmitting-side apparatus 
converts the image file to an image file corresponding to 
the capability of the receiving-side apparatus, further, if 
necessary, performs editing or the like on the image file, 
and retransmits the file. This realizes smooth E-mail 
transmission. 



[0075] Further, as a part of an image file attached to 
an E-mail is used to notify image-file processing capa- 
bility information to the receiving-side, the present 
invention is realized in a conventional system only by 

5 changing an image-file processing program. That is, the 
notification of image-file processing capability can be 
made without greatly changing the system. 
[0076] Further, as the image-file processing capability 
is notified by using a comment field of an image file for- 

10 mat. it is not necessary to greatly change the image-file 
processing program. The notification of processing 
capability information can be made by a simple program 
change such as addition of a program for interpreting 
the information in the comment field and processing the 

is capability information. 

[0077] As many apparently widely different embodi- 
ments of the present invention can be made without 
departing from the spirit and scope thereof, it is to be 
understood that the invention is not limited to the spe- 

20 cific embodiments thereof except as defined in the 
appended claims. 

[0078] An image communication system including 
electronic-mail apparatuses each having a function to 
add image-file processing information to an image file 

25 attached to an electronic mail. The image processing 
capability of each apparatus is examined in advance. In 
a transmitting-side apparatus, an image file is gener- 
ated in accordance with the capability, and an electronic 
mail, to which the image file is attached, is transmitted 

30 to a receiving-side apparatus. Further, if the image file 
attached to the transmitted electronic mail cannot be 
processed by the receiving-side apparatus, the receiv- 
ing-side apparatus notifies the transmitting-side appara- 
tus of clarified cause of processing failure, further, 

35 transmits its image-file processing capability and the 
unprocessed transmitted electronic mail to the transmit- 
ting-side apparatus. Thus, efficient image-file transmis- 
sion/reception can be performed. 

40 Claims 

1. An image communication system for performing 
transmission/reception of an electronic mail 
between a plurality of communication terminals, 
45 wherein a first communication terminal 

among said plurality of communication terminals 
comprising: 

electronic-mail transmission means for trans- 

so mitting an electronic mail; 

an image-file attachment means for attaching 
an image file to said electronic mail; 
reading means for reading an image; and 
conversion means for converting the image 

55 read by said reading means to an image file. 

and wherein a second communication terminal 
among said plurality of communication termi- 
nals comprising: 
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electronic-mail reception means for receiving 
said electronic mail; 

file extraction means for extracting an attach- 
ment file from said electronic mail; 
determination means for determining whether 5 
or not the attachment file extracted by said file 
extraction means is an image file; and 
image processing means for processing said 
image file, 

wherein said first and second communication 10 
terminals transmit/receive an electronic mail to 
which an image file including image-file 
processing information is attached. 

2. The image communication system according to is 
claim 1, wherein said image-file processing infor- 
mation is added to a comment-adding field in 
image-file format data area. 

3. The image communication system according to 20 
claim 1, wherein said image-file processing infor- 
mation includes information on image-file process- 
ing capability of said first communication terminal. 

4. The image communication system according to 25 
claim 1, wherein said image-file processing infor- 
mation includes information inquiring of image-file 
processing capability of said second communica- 
tion terminal. 

30 

5. The image communication system according to 
claim 4, wherein if said second communication ter- 
minal receives an electronic mail, to which an 
image file including information inquiring of image- 
file processing capability of said second communi- 35 
cation terminal is attached, from said first communi- 
cation terminal, said second communication 
terminal automatically generates an image file 
including image-file processing capability informa- 
tion, and transmits an electronic mail to which the 40 
image file is attached to said first communication 
terminal. 

6. The image communication system according to 
claim 1, wherein said image-file processing infor- 45 
mation includes information notifying the result of 
processing on a received image file. 

7. The image communication system according to 
claim 6, wherein said image-file processing infor- so 
mation further includes information on image 
processing capability of said second communica- 
tion terminal. 

8. An electronic-mail apparatus comprising: 55 

electronic-mail transmission means for trans- 
mitting an electronic mail; 



image-file attachment means for attaching an 
image file to said electronic mail; 
reading means for reading an image; and 
conversion means for converting the image 
read by said reading means to an image file, 
wherein before said apparatus transmits an 
image file, said apparatus transmits an elec- 
tronic mail, to inquire the image processing 
capability of a receiving-side apparatus, to said 
receiving-side apparatus. 

9. An electronic-mail apparatus comprising: 

electronic-mail reception means for receiving 
an electronic mail; 

file extraction means for extracting an attach- 
ment file from said electronic mail; 
determination means for determining whether 
or not said attachment file is an image file; 
image processing means for processing an 
image file; and 

electronic-mail transmitting means for transmit- 
ting an electronic mail to which an image file, 
including image-file processing information, is 
attached. 

10. The electronic-mail apparatus according to claim 9, 
wherein said image-file processing information is 
added to a comment-adding field in image-file for- 
mat data area. 

1 1 . The electronic-mail apparatus according to claim 9, 
wherein said image-file processing information 
includes information on image processing capabil- 
ity of said apparatus. 

12. The electronic-mail apparatus according to claim 9, 
wherein if said electronic-mail reception means 
receives an electronic mail to which an image file 
including information inquiring of image-file 
processing capability is attached, said electronic- 
mail transmission means automatically returns an 
electronic mail accompanied by information on 
image-file processing capability of said apparatus. 

13. The electronic-mail apparatus according to claim 9, 
wherein if said electronic-mail reception means 
receives an electronic mail to which an image file 
including information inquiring of image-file 
processing capability of a destination apparatus is 
attached, said image processing means performs 
processing on an image file to be transmitted, 
based on information on image-file processing 
capability of said destination apparatus, 

and wherein said electronic-mail transmis- 
sion means transmits an electronic mail to which an 
image file processed by said image processing 
means is attached. 
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14. The electronic-mail apparatus according to claim 8, 
said image-file processing information includes 
information notifying the result of processing on a 
received image file. 

5 

15. The electronic-mail apparatus according to claim 
14, wherein said image-file processing information 
further includes information on image processing 
capability of said apparatus. 

10 

16. A communication method for an image communica- 
tion system for performing transmission/reception 
of an electronic mail between a plurality of commu- 
nication terminals, comprising: 

15 

an image-file attachment step of attaching an 
image file including image-file processing infor- 
mation to an electronic mail; 
an electronic-mail transmission step of trans- 
mitting said electronic mail; so 
an electronic-mail reception step of receiving 
said electronic mail transmitted at said elec- 
tronic-mail transmission step; 
a file extraction step of extracting an attach- 
ment file from said electronic mail received at 25 
said electronic-mail reception step; 
a determination step of determining whether or 
not the attachment file extracted at said file 
extraction step is an image file; and 
an image processing step of, if it is determined 30 
at said determination step that the attachment 
file is an image file, processing said image file. 

1 7. A computer-readable memory containing a control 
program for an image communication system for 35 
performing transmission/reception of an electronic 
mail between a plurality of communication termi- 
nals, said program including: 

image-file attachment process procedure 40 
codes for attaching an image file including 
image-file processing information to an elec- 
tronic mail; 

transmission process procedure codes for 
transmitting said electronic mail; 45 
electronic-mail reception process procedure 
codes for receiving said electronic mail trans- 
mitted at said transmission process; 
file extraction process procedure codes for 
extracting an attachment file from said elec- so 
tronic mail received at said electronic-mail 
reception process; 

determination process procedure codes for 
determining whether or not the attachment file 
extracted at said file extraction process is an ss 
image file; and 

image processing process procedure codes 
for, if it is determined at said determination 



process that the attachment file is an image 
file, processing said image file. 

18. A communication apparatus comprising: 

generating means for generating an image file 
including information on image-file processing 
capability of said apparatus; and 
transmission means for attaching said image 
file generated by said generating means to an 
electronic mail and transmitting said electronic 
mail. 

19. The communication apparatus according to claim 
18, wherein said image file has a comment field 
where comment information can be set, and 
wherein said generating means sets said informa- 
tion on image-file processing capability in said com- 
ment field. 

20. The communication apparatus according to claim 
18, further comprising: 

electronic-mail reception means for receiving 
an electronic mail; 

discrimination means for discriminating 
whether or not an image file, attached to said 
received electronic mail, includes information 
on image-file processing capability of a receiv- 
ing-side apparatus; and 
storage means for, if said image file, attached 
to said received electronic mail, includes said 
information on image-file processing capability 
of said receiving-side apparatus, extracting 
said information on image-file processing 
capability from said image file and storing said 
extracted information in correspondence with 
said receiving-side apparatus, 
wherein said generating means generates an 
image file attached to an electronic mail, based 
on said information stored in correspondence 
with said receiving-side apparatus. 

21. The communication apparatus according to claim 
18, wherein before said transmission means trans- 
mits said image file, said transmission means 
attaches an image file including information inquir- 
ing of image-file processing capability of a destina- 
tion apparatus to an electronic mail, and transmits 
said electronic mail. 

22. The communication apparatus according to claim 
21, further comprising: 

electronic-mail reception means for receiving 
an electronic mail, 

wherein when an electronic mail, to which an 
image file including information inquiring said 
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image-file processing capability is attached, is 
received, said generating means automatically 
generates an image file including information 
on image-file processing information of said 
apparatus. 

23. The communication apparatus according to claim 
18, further comprising: 



extracting said information on image-file 
processing capability from said image file and 
storing said extracted information in corre- 
spondence with said receiving-side apparatus, 
wherein at said generating step, an image file 
attached to an electronic mail is generated 
based on said information stored in corre- 
spondence with said receiving-side apparatus. 



electronic-mail reception means for receiving 10 
an electronic mail, 

wherein said generating means generates an 
image file including information notifying the 
result of processing on an image file attached 
to a received electronic mail. is 



28. The control method according to claim 25, further 
comprising an inquiry step of transmitting an elec- 
tronic mail to which an image file including informa- 
tion inquiring of image-file processing capability of 
a receiving-side apparatus is attached, prior to said 
transmission step. 



24. The communication apparatus according to claim 
18, further comprising: 



25. A control method for a communication apparatus 
comprising: 30 



29. The control method according to claim 28, further 
comprising a response step of, if an electronic mail 
transmitted at said inquiry step is received from 
another communication apparatus, automatically 
transmitting an electronic mail to which an image 
file including information on image-file processing 
capability of said communication apparatus to said 
other communication apparatus. 

30. The control method according to claim 25. wherein 
at said generating step, an image file including 
information notifying the result of processing an 
image file attached to a received electronic mail is 
generated. 



electronic- mail reception means for receiving 20 
an electronic mail, 

wherein said generating means generates an 
image file including information notifying the 
result of processing on an image file attached 
to a received electronic mail and information on 25 
image-file processing capability of said appara- 
tus. 



a generating step of generating an image file 
including information on image-file processing 
capability of a transmrtting-side communication 
apparatus; and 

a transmission step of attaching said image file 
generated at said generating step to an elec- 
tronic mail and transmitting said electronic 
mail. 

26. The control method according to claim 25, wherein 
said image file has a comment field where com- 
ment information can be set, and wherein at said 
generating step, said information on image-file 
processing capability of said apparatus is set in 
said comment field. 



31. The control method according to claim 25, wherein 
at said generating step, an image file including 
information notifying the result of processing an 
35 image file attached to a received electronic mail 
and information on image-file processing capability 
of said communication apparatus is generated. 



40 



45 



27. The control method according to claim 25, further 
comprising: 

50 

a discrimination step of discriminating whether 
or not an image file, attached to a received 
electronic mail, includes information on image- 
file processing capability of a receiving -side 
apparatus; and 55 
a storage step of, if said image file, attached to 
said received electronic mail, includes said 
information on image-file processing capability, 
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FIG. 10 
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FIG. 11 

EXAMPLE OF IMAGE DESCRIPTION 
IMAGE-PROCESSING CONFIRMATION MESSAGE 



image / ITUFax 



MsgType - 3 



TxMsgID = 970801 1030 



TxFaxNo = 03 - ???? - ???? 



RxFaxNo = 06 - ??? - ???? 



DIS = 00C200 



CompCode = 0 



PageRecSts = OC 



19 



EP0 898 410 A2 



FIG. 12 



IMAGE DESCRIPTION FORMAT 



NUMBER 


CONTENT 


KEYWORD 


VALUE 


1 


CAPABILITY EXCHANGE 
KEYWORD 




image / ITUFax 


2 


MESSAGE TYPE 


MsgType 




3 


TRANSMISSION 
MESSAGE ID 


TxMsgID 




4 


RESPONSE MESSAGE ID 


RspMsgID 




5 


TRANSMISSION FACSIMILE 
NUMBER 


TxFaxNo 




6 


RECEPTION FACSIMILE 
NUMBER 


RxFaxNo 




7 


COMPLETION CODE 


CompCode 




8 


PAGE RECEPTION STATUS 


PageRecSts 




9 


T. 30 SIGNAL 


SIGNAL NAME 


FIF OF T. 30 



20 

BNSDOCID: <EP 0898410A2J,> 



(19) 



J 



(12) 



(88) Date of publication A3: 

15.12.1999 Bulletin 1999/50 



Europaisches Patentarrrt 
European Patent Office 
Office europeen des brevets (11) EP0 898 410 A3 

EUROPEAN PATENT APPLICATION 

(51) IntCI. 6 : H04N 1/00 



(43) Date of publication A2: 

24.02.1999 Bulletin 1999/08 



(21) Application number: 98115628.4 

(22) Date of filing: 19.08.1998 



(84) Designated Contracting States: 


(72) Inventor: Maeda, Toru 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


Ohta-ku, Tokyo (JP) 


MC NL PT SE 




Designated Extension States: 


(74) Representative: 


AL LT LV MK RO SI 


Pellmann, Hans-Bernd, Dipl.-lng. et al 




Patentanwaltsburo 


(30) Priority: 21.08.1997 J P 24049697 


Tiedtke-Buhling-Kinne & Partner 




Bavariaring 4 


(71) Applicant: 


80336 Munchen (DE) 


CANON KABUSHIKI KAISHA 




Ohta-ku Tokyo 146 (JP) 





(54) Image communication system using electronic mail and control method therefor 



(57) An image communication system including 
electronic-mail apparatuses each having a function to 
add image-file processing information to an image file 
attached to an electronic mail. The image processing 
capability of each apparatus is examined in advance. In 
a transmitting-side apparatus, an image file is gener- 
ated in accordance with the capability, and an electronic 
mail, to which the image file is attached, is transmitted 
to a receiving-side apparatus. Further, if the image file 



attached to the transmitted electronic mail cannot be 
processed by the receiving-side apparatus, the receiv- 
ing-side apparatus notifies the transmitting-side appara- 
tus of clarified cause of processing failure, further, 
transmits its image-file processing capability and the 
unprocessed transmitted electronic mail to the transmit- 
ting-side apparatus. Thus, efficient image-file transmis- 
sion/reception can be performed. 



CO 
< 

o 

CO 

o> 

CO 

o 

Q. 
LU 



tUAQE REAOjNQ 



TRANSMISSION 

PRT 



^« r 



DESTINATION CAPABILITY] 

1 



DESTINATION CAPABILITY 
STORAGE UMTT 1 



TIMER 



FIG. 1 



"TRANSMITTING-SIDE 

ELECTRONIC-MAIL 

APPARATUS 



2 ftECSVNG-SDE 




I TRANSMISSION 








| PROCESSOR 








' | 

+ ^12 






^16 




SE 


If 






CAPABILITY 
NOTtHER 



"BEST 

MOTHER 



Primed by Xerox (UK) Business Services 
2.16.7/3,6 



BNSDOCID: <EP 0898410A3J_> 



EP 0 898 410 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 98 11 5628 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Citation of document with indication, where appropriate, 
of relevant passages 



Category 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (hit.CI.6) 



X 
Y 

X 
Y 



Y 
A 



WO 97 10668 A (KULAKOWSKI ROBERT T) 
20 March 1997 (1997-03-20) 

* page 14, line 1 - page 15, line 15; 
figures 1-4,8 * 

* page 21 * 

* page 24 * 

W0 97 22203 A (MATSUSHITA GRAPHIC 
C0MMUNIC) 19 June 1997 (1997-06-19) 

* column 2, line 35 - column 4, line 21: 
figures 1-3 * 

& EP 0 887 994 A (MATSUSHITA GRAPHIC 
C0MMUNIC) 30 December 1998 (1998-12-30) 

US 5 528 383 A (MAE I Y0SHIHIR0 ET AL) 
18 June 1996 (1996-06-18) 

* the whole document * 

WO 97 26753 A (LINK WORLDWIDE INC I) 
24 July 1997 (1997-07-24) 

* abstract * 

EP 0 652 666 A (MICROSOFT CORP) 
10 May 1995 (1995-05-10) 

* the whole document * 



The present search report has been drawn up for all claims 



1,8,9, 
16,17 
18,19, 
25,26 



1,2,9,10 
18,19 



2-7, 
11-15, 
20-24 
25,26 



H04N1/00 



TECHNICAL FIELDS 
SEARCHED (lnt.CI.6) 



H04N 



Place ol search 

THE HAGUE 



Date of completion ot the search 

15 October 1999 



Examnar 

Hanratty, C 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant it taken alone 

Y : particularly relevant if combined with another 

document of the same category 
A : technological background 
O : non-written disclosure 
P : intermediate document 



T : theory or principle underlying the invention 
E : earlier patent document, but published on. or 

after the filing date 
D : document cited in the application 
L : document cited tor other reasons 



& : member of the same patent family, corresponding 
document 



BNSDOC1D: <EP 089S410A3_I_> 



EP0 898 410 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 98 11 5628 



This annex lists the patent family members relating to the patent documents cited in the above-mentioned European search report. 
The members are as contained in the European Patent Office EDP file on 

The European Patent Office is in no way liable for these particulars which are merely given for the purpose of information . 

15-10-1999 



Patent document 
cited in search report 



Publication 
date 



Patent family 
members) 



Publication 
date 



WO 9710668 



WO 9722203 



US 5528383 



WO 9726753 A 
EP 0652666 A 



20-03-1997 



AU 7010596 A 
CA 2231830 A 
EP 0850532 A 



19-06-1997 



JP 9163064 A 
CA 2241249 A 
EP 0887994 A 



18-06-1996 



JP 
JP 



2755153 B 
7212561 A 



24-07-1997 
10-05-1995 



AU 



1749797 A 



US 
CA 
JP 



5473691 A 
2134619 A 
7219868 A 



01-04-1997 
20-03-1997 
01-07-1998 



20-06-1997 
19-06-1997 
30-12-1998 



20-05-1998 
11-08-1995 



11-08-1997 



05- 12-1995 

06- 05-1995 
18-08-1995 



w For more details about this annex : see Official Journal of the European Patent Office. No. 12/82 



BNSDOCID: <EP 08984 10 A3_l_> 



f 

t * » - - » 

'u 

4 

T 



THIS PAti£ BLANK (uspto) 



